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(54) Action analyzing/recording system 

(57) The action of a user who is carrying a movable 
terminal (1) is analyzed in a host terminal (3). The port- 
able terminal ( 1 ) detects the time and position where the 
portable (1 ) terminal is present at a predetermined time . 
interval and supplies the pieces of irrtormation to the 
host terminal (3). The host terminal (3) analyzes the 
time-serially detected information to recognize the mov- 
ing tocus and the moving speed of the user who. is car- 
rying the movable terminal (3). The host terminal (3) 



has position information of railway lines and roads as 
line patterns- By matching processing between the 
moving locus and the line patterns, the transport facility 
used by the user for movement is estimated. This inven- 
tion is to provide a system capable of artatyzing/record- 
ing a daily action without performing any cumbersome 
Gpeiation. 
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Description 

The present invention relates to a system for ana- 
lyzing the action of. e.g., a user who is carrying a porta- 
ble terminal on the tiasis of infomnation acquired from 5 
the portable temrtinal. 

Information r^resenting the dateffime and position 
of a visit, and in some cases, information of a transport 
fadlrty used need often be recorded as a daily action 
record. ' 

In such a case, the user makes a note on the self 
action in a pocketbook or the like, or inputs the daily 
action to a personal computer or the like after he/she 
goes back to the office. In recent years, a portable ter- 
minal is becoming popular, and instead of writing the is 
action in the pocketbook, the action record ntay be 
sometimes input to the portable terminal- 

The operatran of writing the daily action record in 
the pocketbook or inputting it to the personal computer 
is cumbersome. In addition, the writing or data input 20 
operation is often forgotten, so no accurate action 
record can be made. 

It is an object of the present invention to provide a 
system for automatically analyzing outdoor action and 
recording it as an action record without performing any 2s 
cumbersome recording operation. 

To achieve the above object there is provided an 
action analyzing/recording system wherein information 
transmitted through a communication control unit of a . ^ 
terminal is analyzed by an informatton processing unit ' 30 
connected to a network as an action record, data of an 1 
analysis result is stored in correspondence with a termi- 
nal identification code, and the data is transferred to 
said terminal as needed, said terminal comprising a v " 
detector for detecting position information and time . -35 
information, and said communication control unit for 
network connection, and transmitting the information 
detected by said detector together with the ternranal 
identification code. 

According to the present invwition. the action of the 40 
user who is holding the terminal outdoors can be ana- 
lyzed, and the means of transportation can be esti- 
mated. Therefore, an accurate action can tw - 
automatically input witfiout requiring the user of any 
specific input operation. In addition, since the analyzed -45 
data is recorded, the data can be referred to later as a 
personal action record or record in a goods delivery 
(^ration and applied to various application purposes. 

This invention can be more fully urxlerstood from 
the following detailed description when taken in con- so 
junction with the accompanying drawings, in which: 

FIG. 1 is a view showing the system configuration of 
an emtxxJiment; 

FIG. 2 is a perspective view showing ttie outer 55 
appearance of a portable terminal; 
FIG. 3 is a block diagram of the portable terminal;. 
FIG. 4 is a view showing the structure of a packet 



sent from the portable terminal ; 
FIG. 5 is a flow chart of an operation of preparing a 
packet from data acquired by the portable terminal 
and saxJtng the packet; 

FIG. 6 is a block diagram showing the arrangement 
of a host terminal; 

FIG. 7 is a flow chart for explaining processing in 
the host terminal ; 

FIG. 8 is a view showing an example of the moving 
route of a user who is carrying the portable termi- 
nal; 

FIG. 9 is a view showing an example of nnap data 
stored in the host terminal; r 
FIG. 10 is a flow chart (1) of processing of estimat- 
ing tiie action of the user who is canrying the porta- . 
bleterminal; 

RG, 1 1 is a flow chart (2) of processing of estimat- 
ing the action of the user who is carrying the porta- 
t)le terminal; 

FIG. 12 is a flow chart (3) of processing of estimat- 
ing the action of the user who is carrying the porta- 
ble terminal: . 

FIG. 13 is a view showing an example of the result 
obtained by estimating the action of the user who is 
carrying the portable terminal; 
FIG. 14 is a view showing an example of an action 
record taWe of the user who is.carrying the portable 
terminal; . 

FIG. 15 is a flow chart of processing of preparing 
the action record table of the user who is carrying 
the portable terminal; 

FIG. 1 6 is a table which stores names on a map and 
corresponding position information: 

. FIG. 17 is a flow chart of an operation of preparing 
a packet from data acquired by the portable termi- 
nal and sending the packet; and 
FIG. 18 is a view illustrating tiie action record of the 

. user who is carrying the portable terminal. 

TTie embodiment of the present invention will be 
descrtoed below with reference to tiie accompanying 
drawing. 

. FIG. 1 is a view showing the system configuration of 
this embodiment.. In this emt)odiment a system for ana- 
lyzing ttie action of a user having a portable terminal 1 
in a host terminal (server machine) 3 accommodated in 
a public network 2 will be described. Assume that tfw 
user is always carrying the portable terminal 1 . 

The portable terminal 1 detects the position (e.g., 
aa^lib* north and cc°dd' east) of tiie portable.terminal 1 
at a certain time point and this time autonomously or in 
accordance with an instruction from the portable termi- 
nal 1 sr\d supplies the position and time information to 
the host terminal 3. At tfiis time, the portable terminal 1 
is connected to the public network 2 through the nearest 
base station 4. Upon being notified of ttie position and 
time, the host terminal 3 recognizes the position of the 
user who is carrying the portable terminal 1 at the cer- 
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tain time. 

The portable terminal 1 supplies the information 
(position information and time information) to the Kost 
terminai 3 at every predetermined timing. The host ter- 
minal 3 analyzes the time-serially detected inforrration, 
thereby recognizing the moving locus and the moving 
speed of the user of the portable terminal 1 . 

FIG. 2 is a perspective view showir^ the out& 
app^rance of the portat»le terminal 1 . The portable ter- 
minal 1 has an LCD display unit 11. a microphone 12, 
and a general-purpose IF connector 13. A GPS (Global 
Positioning System) sensor 14 is connected to the gerv 
eral-purpose IF connector 13. The portable terminal 1 
has a radio communication antenna 15. 

FIG. 3 is a fcrfock diagram of the portable termirtal 1 . 
A CPU 21 executes a program stored in a storage unit 
22 (ROM and RAM). The CPU 21 and the storage unit 
22 are connected via a bus 23. • • 

The storage unit 22 is constituted by a senniconduc- 
tor memory, a magnetic recording mediunx or an optica) 
recording medium and stores the program, data, and 
the like. The storage unit 22 may l>e permanently incor- 
porated or detachably mounted in the pxjrtable terminal 
1. ' ' ■ 

A recording medium driver 24 is connected to the 
bus 23 to read out data stored in a portable recording 
medium (including a semiconductor memory, a mag- 
netic disk, an optical disk, and a magnetooptical <£sk) 
25 or write data in the p)ortable recording medium 25. 
An IC card is assumed as an exanple of the portable 
recording medium 25. The CPU 21 can also execute a 
program stored in the portable recording medium 25. i 

The program and data to be recorded in the storage 
unit 22 may be received from another device connected 
through a communication line or the like, and recorded. 
Alternatively, the CPU 21 may use, through the commu- 
nication line or the like, a program and data stored in a 
storage unit arranged on the another device side. 

A unit corresponding to the LCD display unit 11 
comprises a liquid crystal display (LCD) 31. a memory .. 
32 for storing information to be displayed on the Tiquid 
crystal display 31 , an LCD driver 33 for outputUng infor- 
mation stored in the menrK)ry.32 to the Bquid crystal dis- 
play 31 under the control of an LCD control unit 34, and- 
the LCD control unit 34 for: controlling the menxwy 32 
and the LCD driver 33. 

An A/D converter 35 converts sound information 
acquired through the microphone 12 into digital data. A 
sound information control unit 36 outputs the sound 
information A/D -converted by the A/D converter 35 to 
the bus 23. The sound information control unit 36 has a 
function of compressing sound information. 

The GPS sensor 14 detects the current position tiy 
communicating with. e.g.. an artificial satellite. A gen- 
eral-purpose IF unit 37 outputs detected data from the 
GPS sensor 14 to the bus 23 in accordance with an. 
instruction from the CPU 21. A timepiece 38 counts 
time. A timer 39 interrupts the CPU 21 at a predeter- 



mined time intCTval. 

In sending data, a communication control unit 40 
prepares a transm^sion packet and trarsfers the packet 
to a radio transceiver 41 in accordance with an instruc- 

5 tionfromtheCPU21. Inrecavingcteta, thecommunica- 
fion control unit 40 outputs data stored in a packet 
recced through the radio transceiver 41 orrto the bus 
23- The radio transceiver 41 e connected to the racfio 
communication antenna. 15 shown in FIG. 2 to trans- 

10 mit/receive data to/from the base station 4. 

FIG. 4 is a view showing the structure of a packet 
sent from ttre portable terminal 1 . Each packet is consti- 
tuted by a header portion and a data portion. The 
header portion stores a transmission, source address, a 

15 transmission destination address, and the like. The 
address system contairting an address to be stored as a 
transmission source address or a . transmission destina- 
tion address - is determined depending on the network 
structure to which this embodiment is applied. In. e.g., 

so TCP/IP communication, an IP address is stored. 

The data portion stores af^lication identification 
information, a command, position information, time 
. information, and sourrf : information. The application 
identification information is used to identify an apptica- 

2S Hon program to be started on a destination terminal 
(host terminal 3 in this embodiment). In thris embodi- 
ment information for identifying an action analysis pro- 
gram is set Note that in TCP/IP communicatton. the 
application identification information is designated as a 

30 port nunrtoer. 

The command is instruction Intorrnation for the ter- 
minal (host temmnal 3) designated by the fransmissfon 
destination address and is interpreted on an application 
designated by application identification information. In 

35 this embocfimertt an action analysis command or an 
analysis result request command is used. 

The position information represents the position of 
the portat>le terminal 1 and corresponds to the psosition 
of the user who is can-ying the portat)le terminal. This 

40 position information is sequentially prepared on the 
basis of the output from the GPS sensor 14. The time 
information r^>resents time when the position informa- 
tion, i.e., the output from the GPS sensor 14 is detected, 
. and corresponds to the output from the timepiece 38. 

45 The sound irrformatiorr is sound data. acquired through 
ttie microphone 1 2 at the timing when the position infor- 
nf«tion is detected. In this embodiment. sourxJ informa- 
tion is acquired. as ambient information of the portaWe 
terminal 1 . However, a temperature sensor or a camera 

50 may be arranged to acquire temperature or image infor- 
mation as ambient information. ' 

FIG. 5 is a flow chart of an operation of preparing a 
packet from data acquired by the portatile terminal and 
sending the packet The program tor realizing the func- 

55 tions of this flow chart is stored in the storage unit 22 as 
a form of program code wftich can be read by the CPU 
21 . In this processing, the portable terminal 1 acquires 
position information, time information.- and sound irrfor- 
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mation N times at a predetermined time tntervai. trans- 
fers all the acquired information to the host terminal 3, 
and requests action analysis processing. Assume that 
the portable terminal 1 is always executing the program 
for acquiring position information, time information, and 5 
sound information while the power is ON. 

In steps SI and S2, predetermined time interval 
data is set for the timer 39. and the timer 39 is started. 
When the timer 39 has counted a predeternnined time 
<e.g., one minute), an interrupt signal is input to the CPU 10 
21 via the bus 23. so that processing from step S3 is 
executed. 

In step S3, the output (position information) from 
the GPS sensor 14 is acquired. In step S4, the time 
(time information) counted by the timepiece 38 is is 
acquired. In step 35. the timer 39 is reset., In step 86, 
ambient sound data (e.g., noise) collected through the «. 
micrc^hone 12 is acquired. This sound collection 
processing is performed for, e g., 5 seconds. The timer 
39 is reset and starts the time counting operation again, so 

In step 87. the infbrnrtation acquired in steps S3, 
S4. and S6 are temporarily held in the RAM in the stor- 
age unit 22. In step S8, a counter (not shown) is incre- 
mented by one. In step 89. the count value of the 
counter is checked. If the count value lias reached "N 25 
(N: positive Integer)", the flow advances to step 810. H 
the count value has not reached N. the f tow returns to 
step 82 (to wait for the next interrupt signal from the . 
timer 39). In step SIO. the count value of the counter is ; . :■ 
cleared, 30 

In step S11 , the packet shown in FIG; 4 is prepared. 
The addresses of the portable terminal 1 and the host ' - 
terminal 3 are set as a transmission source address and 
a transmission destination address, respectively. As 
application identification information and a commarKi, 3S 
an "action analysis program" and an "action analysis 
command" are set. As position information, time infor- ■ 
mation, and sound information, the pieces of informa-; 
tion acquired in steps S3. S4, and 86 are read out from 
the storage unit 22 and stored in the packet. The posi-- .40 
tion information, time information, and sound informa-r .. 
tion to be stored are data acquired N times. In step Si 2. 
the packet prepared in step Si 1 is output by radio. The 
packet is transferred to the host terminal 3 in accord- 
ance with the transmission destination address set in 4S 
the header portion. 

In the above embodiment, all the acquired data cor- 
responding to N cycles are transferred from the portable 
terminal 1 to the fiost terminal 3 to reduce the transmis- 
sion cost. However, the data may be transferred when so 
the acquired data reaches a predetermined capacity. 
AHernativefy. position infomration, time information, or 
sound information may be trarrsferred to the host termi- 
nal 3 every time the information © acquired. In the 
above embodiment the flow chart shown in FtG. 5 is 55 
autonomously executed by the portat)le terminal 1 . 
Alternatively, the processing of transmitting the packet 
to the host side may be executed in accordance with a 
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Starting instruction which is regularly transmitted from 
the host terminal 3. 

FIG. 6 is a block diagram of the host terminal 3. A 
storage unit 51 is constituted by a semiconductor mem- 
ory, a magnetic recording medium, or an optical record- 
ing medium and stores a program, data, and the like. 
The storage unit 51 may be permanentiy incorporated 
or detachatily mounted in the host terminal 3. 

A recording medium driver 52 reads out data stored 
in a portable recording medium (including a semicon- 
ductor memory, a magnetic disK an optical disk, and a 
magnetooptical disk) 53 or writes data in the portable 
recording medium 53. A communication control unit 54 
ccOTtrols data transmission/reception to/from the net- 
work Packet tiansmission^eception to/from each porta- 
ble terminal is also controlled t»y. the communication 
control unit 54. 

A CPU 55 loads the program from the storage unit 
51 or the portable recording medium 53 and executes 
the program. The program and data recorded in ttie 
storage unit 51 may be written from the portable record- 
ing medium 53 or received from another device on the 
network through the communication line or the like and 
recorded- The CPU 55 may use a program and data 
stored in arxrther storage unit arranged on the network 
through the communication line or the like. 

FIG. 7 is a flow chart for explaining processing in 
the host terminal 3. In this exannple, a packet sent from 
the portable terminal 1 (packet prepared with process- 
ing of the flow chart shown in FIG. 5) is received to ana- 
lyze the action of the user who is carrying the portable 
terminal 1 . 

In step S21. the transmission source address 
stored in the header portion off the received packet is 
checked to recognize the transmission terminal. In this 
case, the transmission termir^ is assumed to be tfie. 
portable terminal 1. The application identification infor- 
mation and the command are checked. In this case, 
assume that an "action analysis program" ana an 
'action analysts command" are set 

In step 322. position information arKf time informa- 
tion, which are stored in the data portion of the received 
packet, are extracted to recognize the position (Xj.yj) of 
the portatrfe terminal 1 at time T;. In step 323, the mov- 
ing ctirection and moving speed of the portable terminal 
1 from time T^.^ to time Tj are calculated. 

In step S24. the calculation result obtained in step 
S23 is used to estimate the moving means (walking, 
train, rruTtor vefiide. stop. • • • ) of the user who is car- 
rying the portable terminal 1 . More specifically, the posi- 
tion of the user who is carrying the portable terminal 1 
at a certain time point, and if he/she is moving, the mov- 
ing means are estimated. In this processing of estimat- 
ing the moving means, sound information stored in the 
data portion off the received packet is used, as needed. 
In step 825. the estimation result obtained in step 824 
is stored in the personal action fSe of the user who is 
carrying the portat>le ternrunal 1 . 
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The operation of the flow chart shown in FIG. 7 will 
be described betow in more detail. A case wherein the 
user who was carrying the portable terminaJ 1 moved 
from station A to station B by A railway, as shown in FIG. 
8. win be descrft>ed. s 

Upon receiving an action recording start command 
from a key input means (not shown) of the portatrfe ter- 
minal 1 . or the host terminal 3, the portalile terminal 1 
executes the processing of the flow chart shown in FIG. 
- 5 and detects the output from the GPS sensor 14 at time io 
To. T2. • • •. T10- The detected pieces of position 
information correspond to position data Pq, Pi. P2. 
• • Pio- detecting the position irrfornriation, the 
portable terminal 1 fetches sound information acquired 
through the microphone 12. For example, it is estimated ^5 
thai, in a station, various types of noise are detected, 
ard in a train, sounds unique to the train are detected. 
The portable terminal 1 transfers the detected position 
information, time information, and sound information to 
the host tenminal 3. Since the data detected by the GPS 20 
sensor 14 have errors, points designated lay the position 
irrformation (position data Pq, Pi- Pzt ' ' * ■ Pio) cIo not 
always match the line. 

Upon receiving the information transferred from the 
portable terminal 1 . the host terminal 3 executes the: 25 
processing of the flow chart shown in F!G. 7 to analyze 
the moving route of the user wfro is carrying the porta- 
tjle terminal 1 . For the purpose of analyzing the route, 
the host terminal 3 has map data as shown in FIG. 9. 
FIG. 9 shows part of the position information of the line so 
of A railway (position information of the line between 
station A and station B) as an example. 

As shown in FIG. 9, pieces. of information repre- 
senting the positions of stations (in this case, station A 
and ^tion B) are stored. The position information of 35 
the line is stored as approximate curves of the line. In , 
this example, the tine between station A and station 8 is 
divided into four sections, and an approximate curve 
equation is defined for each section. ■ 

The host terminal 3 also stores map data associ- .40 
ated with an railways. Not only data associated with rail- 
ways but also data associated with roads are stored in 
the host terminal 3. These map data are stored in. e.g., 
the storage unit 51 and loaded in the memory 56 as a 
reference, as needed. 4S 

FIG. 10 is a flow chart (1) for explaining processing 
of estimating the action of the user who is carrying the 
portable terminal 1. This processing conresponds to 
steps S23 and S24 in FIG. 7. 

In step S31 . the average moving speed of the us^ so 
who is carrying the portebJe terminal 1 is calculated. 
More specifically, the average nujving speed of the port- 
atrfe terminal 1 from time Tj.i to time Tj is calculated 
according to the following formula. At tSnas time, ttie mov- 
ing direction is simuHaneousty calculated: 55 



In step S32, it is checked whether the speed calcu- 
lated in step S31 is 1 km/h or less, tf YES in step S32. it 
is estimated in step S33 ttiat the user is "stoppir^g". If 
NO in step S32. the f tow advances to step S34. 

In step S34. it is checked whether the speed calcu- 
lated in step S31 is 6 km/h or less, if YES in step S34. it 
^ estimated in step 835 tliat the user is "talking'. If MO 
in step S34. the flow advances to step S36. 

In step S36, it is checked whether the moving bcus 
of the user who s carrying the portable terminal 1 ^ 
similar to the railway line pattern stored as map data. In 
this case, distances from the points designated t>y posi- 
tion data Pq.'Pi. Pg. * * *. Pio to the curves repre- 
sented by the curve equation representing the railway 
line are calculated by, e.g., the method of least squares, 
and determination is made on the basis of whether each 
calculated value is equal to or smaller than a predeter- 
mined value. Alternatively, determination is made on the 
basis of the simitarHy between a locus drawn by at least 
two petition data arvl a curve pattern representing the 
. railway line. Determination in this step is pelormed 
using a known technique, and a detaHed description 
thereof will be omitted. - 

If the moving locus of the user who is carrying the 
portable terminal 1 is similar. to the fine pattern, it is esti- 
mated In step S37 that the user is "moving by ti-ain". If 
the moving locus is not similar to the line pattern, it is 
estimated in st^ 838 that the user is 'moving by motor 
vehicle (automobile or bus)". 

. The estimation result obtained in this way is held in 
a predetermined area on the memory 56 as data of 
action (movement situation) of the user wtK> is carrying 
the portable terminal 1 at a certain time point. The host 
terminal 3 sequentially stores the estimation result data 
at each time (time when the position information and. the 
like are detected by the portatrte terminal 1). 

FIG. 1 1 is a flow cfiart (2) for explaining processing 
of estimating the action of the user who is carrying the 
portatJe terminal 1. :This processing corresponds to 
step S24 in FIG. 7 and is executed parallel to the 
processing shown in FtG. 10. 

In step S41 . sound information stored in the packet 
transferred from the portable terminal 1 is extracted. In 
step 842, the sound information is analyzed to recog- 
nize the characteristic features of the sound informa- 
tion. In step S43, it is checked whether the sour»d 
inftwnnation analyzed in step S42. includes unique 
sounds gen^ated in a running train. If YES in step S43. 
it. is estimated in step S44 that the user is 'moving by 
train", tf NO in step S43. ttie flow advances to step 845. 

In step S45. it is checked whe^er the sound infor- 
mation analyzed in step 842 includes unique sounds 
generated in a running motor vehicle or t)us. If YES in 
step S45, it is estimated in step S46 that the user is 
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"moving by motor vehicle". If NO in step S45, the sound 
infonnation is discarded in this estimation processing. 

The host terminal 3 holds in advance a unique 
sound pattern generated in a running train and a unique 
sound pattern generated In a running automobile or 
bus. In step S43 or S45, the similarity between the 
sound information extracted in step S41 and the held 
pattem is determined. 

The estimation result obtained by processing of the 
flow chart shown in FIG. 11 is used as information for 
irKr easing the likelihood ratio of the estimation result 
obtained by processing of the flow chart shown in FIG. 
10. 

FIG. 12 is a flow chart (3) for explaining processing 
of estimating the action of the user who is carrying the 
portable terminal 1 . In tiiis processing; a pluraBty of esti- 
nnation results are obtained by processing of the flow 
charts shown in FIGS. 10 and 1 1 , and the action of the 
user who is carrying the portable terminal 1 is estimated 
at a higher likelihood ratio on the basis of these pieces 
of information. 

in step S51, M estimation results obtained by 
processing of the flow charte shown in FIGS. 10 and 1 1 
are extracted. When M = 5, and the action at times Tj is 
to be estinrrated, estimation results at time Ti.2. Ti.t, T„ 
Ti+1. and Th.2 are extracted. 

In step S52. it is checked whether all the Wl estima- 
tion results extracted in step S51 are in the same state. 
If YES in step 352, the estimation results are regarded^ 
as an estimation result having a higher likelihood ratio. 
The flow advances to step 861 to hold the result 
together with the position information and the time infor- 
mation. Assume that all the estimation results obtained 
by processing of the flow chart shown in FIG. 10 at 
tirrtes Tj.2. Tj.t. Tj. Tj+i, and Ti^.2 are "stop"; the host ter- 
minal 3 estimates that the user who is carryinig the port- 
able terminal 1 is stopping at the position represerrted 
by the position information at that time, arid stores the 
estinnation result in the mennory 56 or the storage' unit 
51. ; 

If it is determined in step 852 that the estimation 
results are different, it is checked in st^ S54 whether 
the M estinrtation results include only "stc^" and "walk- 
ing". If YES in step S54, it is estimated in step S55 that 
the user who is carryirKi the portable terminal 1 is "walk- 
ing". The f tow advances to step S61 to hold the estiina- 
tion result together with the position information and the 
time information. 

If, in step 854. the estinnation results include esti- 
mation results other than "stop" and "walking"; it is 
checked in step S56 whether a predetermined numt>er 
or more of estirrrati'on results "moving by train" are 
included. If YES in step 856, it is estimated in step S57 
that the user who is carrying the portable terminal 1 is 
"moving by ti-ain". The flow advances to step 861 to hokJ 
the estimation result together with the position informa- 
tion and the time information. 

If NO in step 856, it is checked in step 858 whether 



"moving by motor vehicle (automobile or bus)" is 
included. If YES in step S58. it is estimated in step 859 
that the user who is carrying tiie portable terminal 1 is 
"moving by motor vehicle". The flow advances to step 
5 S61 to hokl the estimation result together with the posi- 
tion information and the time information. If NO in step 
S58, error processing is executed in step S60. 

With the above procedure, estimation results as 
shown in FIG. 13 are obtained. The algorithm tor esti- 
10 mating the action of the user who is carrying the porta- 
ble terminal 1 is not limited to the above algorithm, and 
another method may be used. 

A procedure of preparing an action record table as 
shown in FIG. 14 will be described. FIG. 15 is a flew 
IS chart of processing of preparing the action record table 
of the user wtro is carrying the portaisle terminal 1 . 

In step 871 , "stop" is extracted from the estimation 
results shown in FIG. 13, and the start time and end 
time are checked. The position inforrration is also 

20 extracted. In step 872, it is checked whether the stop 
position exb^acted in step S71 is a position registered in 
advance. For this deterniination, the host terminal 3 
refers to a table shown in FIG. 16. The table shown in 
FIG. 16 stores various names on the map and corre- 

25 sponding position information.. Railway stations ard 
other public facilities are registered in advance. In addi- 
tion, the user can register a desired location. In this 
errtxxliment "head office", txjsiness office", "Mr. Ks 
house", are registered. 

30 (f YES in step 872, the name of the registration 
position is extracted in step 873. If NO in step 872. the 
region name of the position (e.g., xx Prefecture xx City 
xx) is extracted in step 874. Note that tine host terminal 
3 has a table storing region names and corresponding 

'35 position information. 

bi st^ 875, the registration position name 
' extracted in step 873 or the region rtame extracted in 
st^ 874 is written for the time zone of "stop" recog- 
nized in step 87 1 . Assume that the user wtto was carry- 

'40 ' ing the portatjie terminal 1 was in the head office before 
14:1 0. In this case, the position information detected by 
the portat3le terminal 1 t>efore 14:10 must be equal or 
approximate to position data' (xsoi.ysoi) registered in 
the tab\e shown in FIG. 16. The position information 

-45 detected by the portable terminal 1 is transfared to the 
host terminal 3 artd stored in the table shown in FIG. 1 3. 
In processing in steps 872 through 874. the host termi- 
nal 3 recognizes that the user who was carrying the 
portable terminal was in the head office before 14:10 

50 because the position information detected by the porta- 
. ble terminal 1 is equal or approximate to the positfon 
data registered as the position of the head office. As a 
result, "head office" is written for the time zone before 
14:10. as shown in FIG. 14. 

55 In step 876, the moving means (walking, train, 
automobile, or tuss) represented by the above- 
described estimation result and the start time and end 
time of movement using the moving means are 
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checked. As shown in FIG. 14. the moving means is 
written tor each time zone. When a specific means of 
transportation is used, the means of transportation is 
written in step S77. Assume that it is e^mated from the 
similarity to the railway line pattern stored as map data 
shown in FIG. 9 that the user who was carrying the port- 
atiie terminal moved from station A to station B by A rail- 
way. "A railway" is written as a moving means, and 
region names "station A" and "station B*" are written as 
a starting point and a terminal point, respectively- 

The action record table prepared in the atxve way 
is stored in a predetermined area in the storage unit 51 
of the host terminal 3. When the user who is carrying 
the portatale terminal. 1 .is to display the action record 
table on the portable. terminal 1 , a packet tor requesting 
display of the action record Xabie is sent from the porta- 
ble terminal 1. The request packet has thie structure 
shown in FIG. 4. The addresses of the portable terminal 
1 and ttie host terminal 3 are set as a transmission 
source address and a transmissioh destination address, 
respectively. An "action ar^lysis program" is set as 
application id^ification information, and an "analysis 
result request command" is set as a command. A date 
to be referred to is added as adcfitional information of 
the command. The command and the adtfitional infor- 
mation of the command are input by the user usirig, 
e.g.. a pen input method from the LCD display unit 1 1 of 
the portable terminal 1 . 

Upon receiving die command having the "analysts 
result request command" from the portable terminal 1, 
the host terminal 3 interprets the commarKl and extracts 
the action record table of the user who is carrying the 
portable terminal 1- at the designated date. The 
extracted action record tabie is stored in a packet and 
transfened to the portable terminal 1. The portable ter- 
minal 1 extracts the action record table from the packet 
trartsf erred from the host terminal 3 and displays it on 
the LCD display unit .11 . . - - 

The processing programs executed by the host ter- 
minal 3, i.e., programs for realizing the functions o1 the 
flow charts shown in FIGS. 7. 10, 11, 12. and 15, arxl 
the program for interpreting a command transferred 
from the portable terminaJ 1 and processing the com- 
mand are stored in. the storage unit 51 or the portable 
recording medium 53 in the form of program codes 
which can be read by the CPU 55: Atternativdy. pro- 
grams stored in another device connected through the 
network are used. 

As described above, in the action analyzing system 
of this emboc£ment position information arxl time infor- 
mation are detected by the portable terminal 1 and 
transferred to the host terminal 3. and the action record 
of ttie user who is carrying the portable terminal 1 is 
automaticaliy prepared on the host side. For this pur- 
pose, the portable terminal 1 need have only a function 
of detecting position information and time information 
and transferring them to the host terminal 3, a function 
of requesting the host terminal 3 of an action record. 



and a function of displaying data downtoaded from the 
host terminal 3. That is, the portable terminal 1 need 
nether siore an enormous quantSy of map data nor 
ececute highly precise pattern recognition processing or 

5 various processing which require high-speed process- 
ing. For this reason, the portable terminal 1 can obtain 
an advanced action analysts result without requiring any 
large-capacity memory or high-performance processor. 
In the above embodiment position information and 

10 time information are detected by the portable terminal 1 
at a predetermined timing. However, the present inven- 
tion is not limited to this arrangement. Generally, the 
user of the movable terminal is not always moving and 
• can be considered to stop at a certain position for most 

15 of time. If the user of ttie portable terminal stops at a 
cer^n position for a predetermined time or more, posi- 
. tion information need not be detected every predeter- 
mined time, and not all the positon information need be 
supplied from ttie portable t^minal 1 to the host termt- 

20 . nal 3. 

FIG. 17 is a ftow chart showing an operation of pre- 
paring a packet from data acquired by the portable ter- 
minal 1 and sending ttte packet This processing 
procedure is obtained by adcfing steps S81 through S83 
25 to the ikw chart shown in FIG. 5. 

' In step S81 . it is checked whether the position infor- 
mation obtained in step S3 coincides with position infor- 
mation of one and two cycles before. H NO in step S81 . 
the flow advances to step 87 to continue the processing 
30 in FIG. 5. If .YES in step 381, the position information, 
' <time information, and sound jnformation at the preced- 
ing timing are discarded in step S82. In step S83, the 
counter which is to be InaemefTted by one in step SB is 
. . :decremerrted by one. 

35 Processirtg of the fk3w.,c*iart shown in FIG. 17 will 
be descrft>ed in more detail. A case wherein the user 
who was carrying the rriovable terminal 1 was continu- 
.ously present at position Po and time T^ through time T4 
. (times detected in step 84) will be described. 

40 . "Position Pq" is detected by position detection at 
time T^ and tirneT2, and these data are held in step S7. 
At time T3. "position Pq" is detected again. In step S81 . 
the position data at time T3 coincides with positkjn data 
of one (time T2) and two (time T^) cycles before. The 

45 flow advances to step S82 to discard the position infor- 
matk>n, time information, and sound jnformation 
acquired at the preceding timing (time Tg). Thereafter, 
the position data at time T3 is hdd in step 87. As a 
result, only the pieces of information acquired at time T^ 

so and time T3 are held. 

"Position Pq" is detected at time T4 again. Since, in 
step S81 . position data at time T4 coir%:ides with posi- 
tion data of one (time T3) and two (time T^) cycles 
before, the flow advances to step S82 to cfiscard posi- 

55 tion information, time information, arwl sourKi informa- 
tion acquired at the preceding timing (time T3). At this 
time point, the information at time T2 have been cfis- 
carded. and time T^ con-esponds to the timing of "two 



ISDOCID: <EP oea*SCOAl_L> 



13 



EP 0 834 840 A1 



14 



cydes beffbre". Thereafter, the position data at time T4 is 
hetd in step S7. As a result only the pieces of infomia- 
tion acquired at time and time T4 are held. 

As described above, when the user who was carry- 
ing the movali^e terminal 1 continuousty stayed at a cer- 
tain position for a predetermined time or more, only 
position information, time information, and sound infor- 
mation at the start and erxi of "stop" are held and trans- 
ferred to the host terminal 3. With this arrangement, 
transfer of redundant information (in the above example, 
information acquired at time T2 and time T3) can be 
reduced. 

In the abcve embodiment, the GPS sensor is used 
as a means for detecting the position information of the 
portatde terminal 1 . However, the present invention is 
not limited to this. For a mobile communication network 
whose cell range is narrow, a c^l which is currently 
nnanaging the portaUe terminal may be used as posi- 
tion i nfo jiT iat ion. 

In the above embodiment, the action record table 
has the form of a timing chart as shown in FIG. 14. How- 
ever, the present invention is not limited to this. For 
exanple, an illustration as shown in FIG. 18 may be 
used. 

In the above embodiment, position information or 
time information is detected at a predetermined time 
interval. However, such information need not always be 
detected at a predetermined time interval. Information 
may be appropriately sampled a suffident number of 
times for action analysis. 

In the above emtxxfiment, the action of the user 
who is carrying the movable terminal is analyzed. How- 
ever, the airangement is not limited to the application 
purpose of detecting the human action. The arrange- 
ment can cUso be applied to survey the action pattern of 
an animal or check the delivery state of goods. 

Claims 



1. An action analyzing/recording systeni character- 
ized in Xhat information transmitted through a com- 
munication control unit of a terminal (1) is analyzed 
by an information processing unit connected to a 
network (2) as an action record, data of an analysis 
result is stored in correspondence with a terminal 
identification code, and the data is transferred to 
sakj terminal as needed, said terminal conprising a 
detector (14) for detecting position information and 
time information, and said communication control 
unit (40) for network connection, and transmitting 
the information detected by said detector together 
with the terminal identification code. 



15 



20 



25 



30 



3. A system according to daim 1 . characterized in that 
when FX>srtion information representing thiat said 
tennrunal stays at a certain position is detected, said 
terminal is controDed not to transmit information 
twice. 

4. A system according to daim 1 , characterized in that 
said information processing unit has means (51) for 
storing map information representing a transport 
route including a railway line, specifies information 
of a place of movement on the basis of the map 
irrformation and the position arxJ time information 
transmitted from said terminal, and stores the place 
irrformation together witti tinrre. 

5. A system according to claim 1 , characterized in that 
said information processing unit cafoulates a mov- 
ing speed from the position and time information 
transmitted from said terminal to estimate a nrravtng 
means. 

6. A system according to dai m 5, characterized by fur- 
ther comprising means for detecting ambient infor- 
mation induding soutkI information, and wherein 
said estimating means specifies tfie action route in 
consideration of the detected ambient information. 

7. A system according to claim 5, wherein said infor- 
mation processing unit has means (51) for storing 

. map information represerrting a ti'ansport ' route 
induding a railway line and specifies a name of a 
transport facility on the basis of the map information 
arKf the analyzed moving n>eans. 



35 8. An action anatyzing/recorcfing system comprising: 

means (14) for detecting position infornnation 
and tinr>e information of a terminal: 
means (3, FIGS. 10 and 11) for analyzing a 
'40 moving locus and a moving speed of said ter- 

minal on the basis of the detected position and 
time information; 

means (3, FIG. 12) for estimating an action 
route on the basis of the analyzed data; and 
46 means (3. FIG. 15) for storing, on the basis of 

the estimated action route, information of a 
place and time of action as an action recc»d. 



A system according to daim 1 . characterized in that 
said terminal accumulates the detected informa- 
tion, and after the information has reached a prede- 
termined number or predetermined capacity, 
transmits the accumulated information at once. 
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